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CMOS IMAGE SENSOR WITH 
EXTENDED DYNAMIC RANGE 

CROSS-REFERENCE TO RELATED APPLICATION(S) 

The present application contains subject matter related to a copending U.S. Patent 
5 Application by Fred A. Pemer and Charles Tan titled "CMOS ACTIVE PDCEL SENSOR 
HAVING IN-PIXEL LOCAL EXPOSURE CONTROL", which was filed November 18, 
1998, is identified by Serial No.. 09/195,588, and is hereby incorporated herein by reference 
in its entirety. 

O TECHNICAL FIELD 

1^ 10 The present invention relates generally to imaging sensors and more particularly to an 

ro imaging sensor utilizing CMOS active pixels. 

-™ 

T BACKGROUND ART 

ilJ Active Pixel Sensors (APSs) are utilized in various imaging devices, such as 

telescopes, digital cameras, and video recorders. An APS captures an image of a scene of 

O 15 interest by converting incident light from the scene into electrical signals in an analog form. 
A typical APS has an array of "pixels" or discrete regions on a semiconductor device with 
each pixel containing a light sensitive element. Each light sensitive element in a pixel 
generates a separate electrical current, which is proportional to the intensity of the incident 
light on that element. Over the exposvire time of the pixel, the current is integrated into a 
20 voltage. The analog voltage is converted into a digital value by an analog to digital converter 
(ADC). The digital image data can be stored in memory. The digital image data from all the 
pixels can then be displayed as a composite image on a monitor, printed onto a sheet of 
paper, or analyzed for information concerning the properties of objects in the scene. 

The pixels that are used in conventional APSs can be classified into two types of 
25 pixels. The first type of pixel is commonly referred to as an "analog pixel". An analog pixel 
includes a photosensor, such as a photodiode or a phototransistor, and may include an 
amplifier. An associated ADC and memory are located external to the pixel. Therefore, any 
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current generated by the photosensor is transmitted from the pixel to the extemal ADC as an 
analog signal. 

The second type of pixel is known as a "digital pixel". A digital pixel includes not 
only a photosensor and an amplifier, but also an ADC. In other words, the ADC is contained 
5 within the pixel, along with the photosensor and the amplifier. Thus, the magnitude of 
current generated by the photosensor is digitized within the pixel and can be transferred to 
off-pixel components as a digital signal. 

The prior art APS's, regardless of the pixel type, operated to image a scene of interest 
by quantifying the degrees of radiance from various scene segments. For each scene 
10 segment, a particular pixel quantifies the degree of radiance from the scene segment by 
measuring a photovoltage driven by a photosensor generated current. When a photosensor is 
exposed to incident light from a segment of the scene for a fixed integration or exposure time 
D period, the magnitude of a photovoltage will be dependent upon the intensity of the radiance 
g from the scene that is being imaged by the photosensor. 

^5 Essentially, at the end of a fixed exposure period, the imaging sensor quantifies the 

p magnitude of the photovoltage using an ADC. When the degree of radiance from the scene is 
at a detectable maximum level, the output voltage equals a saturation voltage, Vsat. At the 
Ti mean illumination level, a mean voltage, Vmean, is output. Lastly, at the detectable minimum 
^ level, the voltage is a reset voltage, Vreset- The imaging sensor configured to the limits 
^^0 defined by Vsat and Vreset will be able to differentiate discreet degrees of scene radiance 
that result in a photovoltage between Vsat and Vreskt- However, the amount of 
differentiable degrees of scene radiance that can be detected by an imaging sensor is at least 
partially dependent on the resolution of the ADC. As another factor that affects image 
quality, the radiance sensitivity may be adjusted by shortening or extending the length of the 
25 fixed exposure period. But the adjustment is a tradeoff of increasing sensitivity of either high 
radiant scene segments or low radiant scene segments. 

Although the prior art APSs operate well for their intended purpose, what is needed is 
an imaging sensor having a fast capture of a scene, the ability to capture a scene without 
blurs, and to have a wide d)aiamic range over which images can be captured, i.e., the lightest 
30 to the darkest parts of a scene which can be captured. These needs have been long pending in 
the art, and those skilled in the art have been long unsuccessful in filling these needs. 
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DISCLOSURE OF THE INVENTION 



The present invention provides an Active Pixel Sensor system having photosensing 



circuitry for providing a photosignal related to an intensity of incident light on a pixel during 

an exposure period and converting circuitry operatively connected to said photosensing 
5 circuitry to provide an intensity-time signal in a first diiration or second duration during the 

exposure period in response to incident light of a respective first or second range of 

intensities and to respond to the intensity-time signal to provide a first digital count or a sum 

of first and second digital counts related to the intensity of the incident light of the respective 

first or second range of intensities. The system has the following improvenients over the 
10 previous "digital pixel" scheme: a faster capture of a scene, resulting in the ability to capture 

the scene without blurs, and the scheme improves the dynamic range over which images can 
O be captured, i.e., the lightest to the darkest parts of a scene which can be captured. 

The present invention further provides a method for active pixel sensing by providing 

a photosignal related to an intensity of incident light on a pixel during an exposure period and 
(□15 providing an intensity-time signal in a first duration or second duration during the exposure 
,t period in response to incident light of a respective first or second range of intensities. By 

responding to the intensity-time signal to provide a first digital coimt or a sum of first and 
fy second digital counts related to the intensity of the incident light of the respective first or 

second range of intensities the method permits a fast capture of a scene, the ability to capture 
5^20 the scene without blurs, and a wide dynamic range over which images can be captured, i.e., 

the lightest to the darkest parts of a scene which can be captured. 

The above and additional advantages of the present invention will become apparent to 

those skilled in the art fi-om a reading of the following detailed description when taken in 

conjunction with the accompanying drawings. 



FIG. 1 is a circuit schematic of the digital pixel design of the present invention; and 
FIG. 2 is a time-voltage chart of the light intensity determination process of the 
present invention. 
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BEST MODE FOR CARRYING OUT THE INVENTION 

Organization : 

Referring now to FIG. 1, therein is shown an Active Pixel Sensor (APS) system 10 
including system circuitry 12 and pixel circuitry 13. There is one system circuitry 12 for a 
5 plurality of pixel circuitry 13. 

The pixel circuitry 13 includes photosensing circuitry 14 and analog to digital 
converter (ADC) circuitry 15. The photosensing circuitry 14 includes a photosensor, or 
photodiode 16, which is connected at one end to a ground 18 and to a floating diffusion node 
20 at the other. The photodiode 16 is responsive to incident light 22 to change the voltage 
10 Vfd at the floating diffusion node 20. 

The floating diflfiision node 20 is connected by a reset transistor 24 which has its 
O source connected to a supply voltage Vdd 26 and its gate connected to a reset input 28. 

^-J The floating diffusion node 20 is also connected to the gate of transistor 30, which is 

i'-fk 

configured as a source- follower amplifier. 
Q5 The source-follower transistor 30 is connected to the supply voltage Vdd 26 and to 

,p provide an intensity signal to one input of an analog comparator 32 in the ADC circuitry 15. 

The other input of the analog comparator 32 is coimected to receive a reference-time 
ry signal fi-om an adder 34 in the system circuitry 12. The adder 34 is connected to receive a 
first reference-time signal fi*om a reference voltage Vref input 36 during a first time duration 
G20 and subsequently to add a second reference-time signal from a ramp generator 38 during a 
second time duration. The first reference-time signal is a constant voltage of Vref,init and the 
second reference-time signal is a "ramped" increasing voltage of Vramp- 

The analog comparator 32 output is connected to the clock input 39 of a digital 
storage register 40. The comparator 32 outputs a transition signal on 39 when the difference 
25 of its inputs become O.The input of the digital intensity storage register 40 is connected to a 
counter 42 in the system circuitry 12. The counter 42 has its clock input 44 connected to a 
multiplexer (MUX) 46. 

The MUX 46 has a multiplexer control input 48 which controls which input, a clock 
input 50 or 52, is connected to its output 44. A slow (or normal) clock input is provided to 
30 clock input 50 and a fast clock input is provided to clock input 52. The control input 48 
initially is zero to select the normal clock input for the multiplexer. The control signal 48 is 
also connected to the ramp generator 38. A 0-to-l transition at the start input 48 
simultaneously switches the MUX 46 and starts the ramp generator 38. 
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The digital intensity storage register 40 provides the digital pixel value output at a 
digital pixel output 54. 

Since the APS 10 is best understood by reference to a time- voltage chart, the time- 
voltage chart will be described first before describing the system of operation of the APS 10. 
5 Referring now to FIG. 2, therein is shown a time- voltage chart 100 having a time axis 

110 with a series of different time points, Ti 1 1 1 through T4 114, representative of different 
times during the duration of the exposure and a voltage axis 120 showing a reset voltage 
(Vreset) 121, an initial reference voltage (Vref,init) 122, and a saturation voltage (Vsat) 123. 
As would be evident to those skilled in the art, a long exposure period will allow extremely 
10 low intensities of incident light 22 to be sensed but would take infinite time. In the prior art, 
in order to capture images quickly, the lower intensities were not sensed. 
i^j In the time- voltage chart 100, the initial reference voltage 122 is designated by a 

reference voltage line 125 which has a constant and a ramped portion 126 and 127. The point 
m at which the constant portion 126 becomes the ramped portion 127 is designated as the T3 
-.^5 113 time, which is set by a start signal 130 which increases value at time T3 113. The start 
signal 1 30 is the voltage-time waveform for the start signal 48 of Figure 1 . 

The time- voltage chart 100 further contains three exemplary radiance level lines. A 
:r. maximum radiance level line 132 represents the brightest intensity incident light 22 falling on 
H the photodiode 16. The minimum radiance level line 133 represents a very low intensity 
incident light 22 falling on the photodiode 16. A mean radiance level line 134 represents a 
mean intensity incident light 22 falling on the photodiode 16. 

The time Ti 1 1 1 is defined as the intersection of the maximum radiance level line 132 
with the reference voltage line 125. The time T4 114 is defined by the intersection of the 
minimum radiance level line 133 with the reference voltage line 125. And, the time T2 1 12 is 
25 defined by the intersection of the mean radiance level line 134 with the reference voltage line 
125. The entire exposure duration for the pixel is fi-om time Ti 1 1 1 to time T5 1 15. 

Operation : 

At the start of the sensing of a pixel, a reset signal is provided at the reset input 28 
which turns on the reset transistor 24. With the reset transistor 24 on, the supply voltage 
30 input 26 is imposed on the floating diffusion node 20. This provides an initial value to the 
first input of the analog comparator 32. At this time, the second input of the analog 
comparator 32 is receiving Vref.inft applied at the initial reference voltage input 36. The 
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output of the comparator is initially 0. The control input 48 of the MUX 46 is initially set to 

provide the slow clock input 50 to the clock input 44 of the coxinter 42. This provides a slow 

count to the digital intensity storage register 40. 

With maximimi radiance level incident light 22, the photodiode 16 will let the voltage 
5 at the floating diffusion node 20 discharge quickly as shown by the high angle of the 

maximum radiance level line 132 in FIG. 2. 

With mean radiance level incident light 22, the photodiode 16 will let the voltage at 

the floating diffiision node 20 discharge as shown by the mean radiance level line 134 in FIG. 

2. This discharges the photodiode 16 less quickly than the maximum radiance line 132. 
10 As the floating diffusion node 20 discharges, the source- follower transistor 30 will 

provide a decreasing voltage to the analog comparator 32. When the voltage from the source- 
™ follower transistor 30 drops below Vref,init at the initial reference voltage input 36, the 
jO analog comparator 32 will clock in the value on the signal line 37 into the digital intensity 
m storage register 40 at time T2 1 12 and a count will be registered at the digital pixel output 54 

which is proportional to the mean radiance level of the incident light 22. 
+ As evident from the above, if the radiance of a scene is less than the mean level, 

longer exposure periods are required before the digital intensity storage register will be 

stopped. To be able to capture very low radiance light levels, this design will require very 
l-^ long exposure periods where there is a long capture time and subsequent blurring of the 

image sensed by a large number of pixels. Conversely, it is also evident that limiting the 

sensing time to shorter exposure periods will reduce the ability to detect incident light at 

lower radiance levels. 

In the present invention for minimum radiance level incident light 22, the APS 10 
initially operates in the manner described for maximum and mean radiance level incident 
25 light. After a predetermined period of time, which is determined heuristically, and which is 
designated as the time T3 113, the start voltage 130 is increased so as to start the ramp 
generator 38 and switch the MUX 46 from the slow clock input 50 to the fast clock input 52. 

Thus, with minimum radiance level incident light 22, the photodiode 16 will let the 
voltage at the floating diffusion node 20 discharge very slowly (compared to the mean 
30 radiance line 134) as shown by the minimum radiance level line 133 in FIG. 2. 

For the minimum radiance level incident light 22, as the floating diffusion node 20 
discharges, the source-follower transistor 30 will provide a very slowly decreasing voltage to 
the analog comparator 32 which will not drop below VREF,iNrr before the exposure time T3. 
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At the heuristically determined time T3 113, the start voltage 130 (start signal 48) will 
increase to cause the ramp generator 38 to provide an increasing '*ramp" voltage which will 
be added to the initial reference voltage input 36 by the adder 34 to increase the voltage at the 
second input of the analog comparator 32. At T3 the control input of multiplexer 46 selects 
the fast clock 52. The fast clock input 52 through the MUX 46 will cause the coimter 42 to 
provide a faster coimt, or a larger nimiber of counts per given time interval, to the digital 
intensity storage register 40. 

As would be evident to those skilled in the art, the duration of the exposure is divided 
into at least two portions and the "ramp" (or multiple ramps if desired) can be any linear or 
non-linear increase corresponding to the counts from the counter 42 which optimizes the low 
intensity light resolution. 

When the voltage from the sovirce- follower transistor 30 drops below the reference 
voltage of the reference voltage line 125 in the ramped portion 127, the analog comparator 32 
will clock in the value on the signal line 37 into the digital intensity storage register 40 at 
time T4 1 14 at a count which is proportional to the minimimi radiance level of the incident 
light 22. 

Thus, with the addition of the system circuitry 12, the APS 10 will provide a faster 
capture time for very low levels of radiance. The faster clock selected after time T3 provides 
greater resolution and increased dynamic range for the low level light levels. 

While the invention has been described in conjunction with a specific best mode, it is 
to be understood that many alternatives, modifications, and variations will be apparent to 
those skilled in the art in light of the aforegoing description. Accordingly, it is intended to 
embrace all such alternatives, modifications, and variations which fall within the spirit and 
scope of the included claims. All matters hither-to-fore set forth herein or shown in the 
accompanying drawings are to be interpreted in an illustrative and non-limiting sense. 



